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ABSTRACT 

Parameter  plane  studies  of  an  optimal  second  order 
regulator  are  presented.   Emphasis  is  placed  on  the 
interpretation  of  the  cost  function  and  the  sensitivity  of 
the  cost  function  to  plant  parameter  incremental  varia- 
tions .   An  analysis  is  made  of  cost  function  weighting 
factors  and  their  effect  on  damping,  speed  of  response, 
and  cost. 
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I.   INTRODUCTION 

The  parameter  plane  study  of  an  optimal  regulator  was 
undertaken  with  the  purpose  of  finding  an  interpretation  of 
the  meaning  of  the  cost  function  and  of  the  weighting  fac- 
tors as  they  relate  to  the  observed  physical  behaviour  of 
the  regulator. 

Chapter  one  gives  a  brief  description  of  the  problem 
formulation;  Chapter  two  describes  some  studies  on  the 
performance  index;  Chapter  three  deals  with  the  study  of 
the  weighting  factors ,  and  Chapter  four  with  some  sensi- 
tivity aspects.   Appendices  A  and  B  deal  with  the  develop- 
ment of  the  general  expression  for  the  R  matrix  and  the 
performance  index. 

A.   PROBLEM  FORMULATION 

Suppose  that  initially  the  plant  input  or  any  of  its 
derivatives  is  nonzero.   Provide  a  plant  input  to  bring  the 
output  or  its  derivatives  to  zero.   In  other  words,  the 
problem  is  to  apply  a  control  to  take  the  plant  from  a 
nonzero  state  to  the  zero  state.   This  problem  may  occur 
where  the  plant  is  subjected  to  unwanted  disturbances  that 
perturb  its  output  (e.g.,  a  radar  antenna  control  system 
with  the  antenna  subject  to  wind  gusts) . 

The  desirable  properties  of  a  regulator  system  should 
be : 


A.  The  regulator  system  should  involve  a  linear 
control  law. 

B.  By  definition  an  optimal  system  is  one  that  mini- 
mizes a  certain  cost. 

To  achieve  property  B,  let  us  define  a  performance  index 

00 

PI  =  /   (XTQX  +  uTPu)  dt 
o 

where  Q  is  symmetric  positive  definite  and  R  is  a  positive 

00 

T 
definite  matrix.   /   X  QX  dt  come  from  the  minimum  integral- 

0 
square  error  problem. 

00    J^  oo 

/    Z   (X.)2  dt  =  /   (XTX)  dt 
o   i=l    1        o 

constituting  a  reasonable  measure  of  the  system  transient 

oo 

T 
response,  and  ;   u  Pu  dt  comes  from  the  minimum  energy 

o 
problem. 

The  minimization  problem,  i.e.,  the  task  of  finding 
an  optimal  control  that  minimizes  the  performance  index, 
turns  out  to  be  achievable  with  a  linear  feedback  law.   This 
is  the  reason  why  the  performance  index  includes  a  measure 
control  energy. 

For  the  infinite-time  regulator  problem  R(t)  is  the 
solution  of  the  reduced  Riccati  equation 

R  A  +  ATR   -  R  BP~1BTR   +  Q  =  0 
o       o    o       o 

with  an  optimal  control  defined  by 

u*(t)  =  -P_1(t)BT(t)Ro  x(t) 
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From  Appendix  A  the  general  expression  for  the  R  matrix 


is 
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U  (x)  =  -p~1BTR  x 
o       c  o 
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P  -1  =  1,     BT  -  [0   K] 


P2  2/qll 
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from  which  the  system  block  diagram  is : 
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Reducing  to  single  block: 
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B.       OPTIMAL    SECOND    ORDER    SYSTEM 
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K   and   p   are   nominal   values    and   K,    and   K~    are    adjusted   so 
that 


Kl  -  i/  p 
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11 
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11 
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(1.4) 


r, ,  and  r,  _  defined  as  in  1.1. 

The  cost  function  for  the  optimal  regulator  is  given  by: 

Jo  =  rnxi(°>  +  2r12x1(o)x2(o)  +  r22  x*(o) 
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And  substituting  the  values  of  K,  and  K~    gives 
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II.   THE  PERFORMANCE  INDEX 

A.   GENERAL 

In  Appendix  B  the  general  expression  of  the  performance 
index  for  a  second  order  system  has  been  derived,  giving, 
for  initial  conditions  on  X  only 


J 
o 


[x.^0)]2 


2    ^11  2 

(Kf  +  -±±)  (p   +  K_K  )£ 
2   qll       1    P1;L    O     2  o  2   q 

(K7  +^t±)     +    ±± +  k,K  (ld  +  -z±.) 

1   PU  KlK()  1  o^  2   pn' 


-  2K,K_(p^  +  K„K  )  \    =-7 ,1T>  -  , 

1  2  ^o     2  o    2 (p   +  K-K  ) 
J    ^o     2  o 


(2.1) 


where   K   is  the  plant  pole, 

K,  and  K«  are  the  gains  of  the  feedback  paths, 
q..,  q?:?/  p.,-,  are  weighting  factors. 

Let      q,,  =  1,  q22  =  0,  p, ,  =  1,  K   =  1600  and  p   =  30 

then y  =  0.04002. 

[x1(0)]^ 


Wh 


en  q„»  =  0,  then  equation  (1.4)  can  be  written  as: 


-2        2 
°    K2   °    K22 

which  is  a  straight  line  on  the  K  vs .  p  plane.   Figure  2.1 
gives  the  values  of  K  required  to  optimize  the  regulator. 

For  example  K  =  .02  is  necessary  to  optimize  a  regulator 

2 
with  a  plant  pole  of  30  and  oo   =  2000. 
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Figure  2.1.   Required  values  of  K_  to  optimize  the  regulator. 
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B.   STUDY  OF  J  ON  THE  PARAMETER  PLANE 

The  cost  function  for  the  optimal  system  was  given  in 
section  A  by 

_2_=  J,  (p  +  k2K)  (2.2) 

i  n 

substituting  K2  =  ~[-p  +  JV      +  2k  ]  into  2.2  gives,  for 
q22  =  0 


=  i  /p2  +  2K  (2.3) 


Pll    K 

Figure  2.2  shows  the  parameter  plane  for  the  optimal  cost 
function  obtained  by  varying  K~  when  p  changes  ,  with  K  as  a 
family  parameter  and  K,  =  1 .   Lines  of  constant  p  and  con- 
stant K  have  been  drawn  for  clarity  of  presentation. 

The  value  of  £  corresponding  to  each  point  in  the  plane 
is  obtained  from 

s2  +  (p  +  KK  )s  +  KK,  =  0 

p  +  KK 
5  =  -———± 

2/KK, 

A  plot  of  constant  £  curves  on  the  K, ,  K~  parameter 
plane  for  K  =  16C0  and  p  =  30  is  shown  in  Figure  2.3. 
From  2.1,  for  q2?  =  0 

2 
'11 


KK2  +  (2P~  2KJi)K2  +  (Ki  +E77)2  +  ifoo  -  2PJi  = 


Choosing  p  =  30,  K  =  1600,  q,  ,  =  p,  ,  =1,  the  contour  in 
J,  -  K_  plane  is  described  by 
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Figure    2.2.      Loci    of   optimal    cost    function,    K,    =    1.0 
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Figure  2.3.   Constant  X,    curves  when  K  =  1600,  p  -  30 . 
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-(.0375  -  2J, ) 


K2  = -2L  +  |  V(.0375-2J1)2  -  4  (.001953-. 0375J1)  (2.4) 

and  if  K„  =  constant  =  .02125 

Jl  =  I2T  [1  +  ^T^"  +  -56256  Ki  +  Ki]  <2-5) 


Equations  2.4  and  2.5  are  represented  on  the  parameter  plane 
in  Figure  2.4.   It  can  be  readily  seen  that  for  K?  =  .02125 
the  curve  shows  a  minimum  cost  of  .04.   The  same  minimum 
cost  is  obtained  keeping  K^  constant  at  a  value  of  .02125 
for  K,  =  1. 
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III.   STUDY  OF  WEIGHTING  FACTORS  OF  THE  PERFORMANCE  INDEX 

When  it  is  desired  to  optimize  the  design  of  a  control 
system,  a  cost  functional  must  be  established.   This  cost 
functional  is  an  analytical  expression,  related  to  the 
system,  which  must  be  minimized  by  choosing  parameters 
which  will  cause  an  extremal  of  the  cost  functional. 

Weighting  factors  used  in  performance  indices  deter- 
mine to  a  large  extent  the  optimal  system  which  results . 

A.   SELECTION  OF  THE  Q  MATRIX 

Optimal  control  law  determination  by  Athans  and  Falb  [1] 
require  that  the  weighting  factors  matrix  be  positive 
definite. 

Tuel  [2]  developed  a  canonical  form  for  the  weighting 
factor  matrix  Q  which  has  the  minimum  number  of  parameters 
required  in  the  performance  index  for  the  computation  of  the 
optimal  control  law. 

The  selection  of  this  Q  matrix  is  a  very  important  part 
of  optimal  design  but  there  is  very  little  guidance  in  the 
literature  in  the  selection  of  the  weighting  factors. 

In  any  regulator  the  output  or  "controlled  variable"  is 
of  primary  interest  and  certainly  must  be  weighted,  being 
never  negative.   Then 

"11  "  ° 

The  velocity  (x„  =  x. )  need  not  be  weighted  at  all 
but  certainly  any  weight  attributed  to  the  velocity  will 


alter  the  dynamic  response  and  may  give  desirable  features 
Thus  • 

q    >  0 
M22 


But  we  should  normally  expect  q„,,  <  q, , 


B.   DERIVATION  OF  EXPRESSION  FOR  STUDY  IN  THE  PARAMETER  PLANE 

For  the  second  order  system  the  characteristic  equation 
is  : 

S2  +  (p   +  K0K  )s  +  K  K,  =0 
^o     2  o       o  1 

where 


1     VP1X 


Po    1   /  2  v2  q22  OL,  v  /qll 

K_  =  -  it—  +  — -v/p  +K  ±  2K  \/ 

2      K     K   v  ^O  O  p,  ,  Ovp,, 

o     o  *ll  *ll 


then 


/  2     2  q22        /qil 
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*o     o  2   V  ^o     o  p..,         pll       n 


2       /ql] 
K  K,  =  co   =  K 


o  1     n    o  ^  p 
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Let 


then 


, [H         q22 
pll         pll 


4c2co2  =  p2  +  K2x  +  2y. 
n   ^o    o     2 
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It  can  be  noted  that  the  constant  C  curves  are  straight 

lines ,  but  the  location  of  the  family  for  0  <  £  <  1  depends 

on  K   and  p  ,  i.e.,  the  effect  of  q.,  ,  and  q„_  can  be  shown 
o      o  ^11      ^22 

only  for  a  specific  plant. 

Figure  3.1  shows  the  parameter  plane  for  the  plant  with 

K   =  1600,  p   =  30. 

o        '  *o 

From  section  B  the  cost  function  for  the  optimal  system 
was  : 
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=  yVp2  +  K2x  ±  2y 
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For  the  optimal  system: 


J,  =  .04,   K   =  1600,   p   =  30 
1  o  *o 
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q22 

A  constant  cost  curve  is  shown  in  Figure  3.2  in  the  vs 

2  Pl1 

to   parameter  plane. 

C.   EFFECT  ON  DAMPING  AND  COST,  STEADY  STATE  ACCURACY 
AND  SPEED  OF  RESPONSE 

In  order  to  study  the  effect  of  the  weighting  factors 

on  damping  in  the  parameter  plane  it  is  necessary  to  use 

1 . 2  and  1.3. 


VPll 


let 


2  q22 
K  -^- 


q22  =  Wqxl 


then 


X.   =  |  v/^-  +  Wz  ±  2  (3.1) 

From  this  equation  the  following  expression  can  be  obtained: 

p2  =  -z(±2  -  4C2)  -Wz2  (3.2) 
As  K  is  defined  in  Section  A  as: 


K2  =  -i^yp2-2g*w;^ 


where 


Pll 
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Ficrure  3.2.   Cost  function  curve  when  K  =1600,  p  =30. 
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Then,  for  q  =  0  the  choice  of  +  sign  will  require  nega- 
tive feedback,  while  the  -  sign  will  require  positive  feed- 
back . 

For  negative  feedback  3.2  can  be  rearranged  to: 

2 

x  =  — ^ for   W  =  0. 

2  -  4C 

Then,  as  z  must  be  positive,  C  must  be  greater  or  equal 
to  .707  noting  that  if  C  =  .707  then  p  =  0. 

In  Figure  3.3  the  parameter  plane  for  W  =  0  has  been 
drawn  for  different  values  of  £  and  in  Figure  3.4  for 
W  ^  0.   In  both  figures,  curves  of  constant  cost  function 
have  been  superimposed. 

It  can  be  noted: 

1.  Minimum  C  for  optimal  regulator  (second  order)  with 
negative  feedback  is  .707,  and  this  occurs  only  when  W  =  0. 

2.  For  W  >  0,  C  >  .707. 

3.  As  W  increases,  the  system  rapidly  becomes  over- 
damped. 

4.  If  p  is  large  the  system  will  be  very  heavily 
damped,  no  matter  what  the  gain  is. 

5.  For  W  >  0  if  the  gain  is  raised,  the  system  C  goes 
thru  a  minimum  and  then  increases  with  gain. 

6.  The  larger  W,  the  more  velocity  feedback  is  required 

For  plotting  of  cost  functions ,  K  has  been  kept  constant 

/^ll  F*ll 

at  1600  and./ varied  in  Figure  3.3a  and  / kept  con- 

V  P11  y  v/  Pll 

stant  at  1  and  K  varied  in  Figure  3.3b. 
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Figure  3 .3 a .   Parameter  plane  optimal  regulator  when 
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,  negative  tachometer  feedback  for  J  curves 


W  =j 

K  assumed  to  1600. 
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From  these  two  figures  the  following  results  can  be 
established: 

1.  For  K  constant,  the  cost  function  increases  with. 
increasing  weighting  factor. 

2.  For  constant  weighting  factor  the  cost  function 
decreases  with  increasing  gain. 

Figures  3.4a  thru  3.4d  show  the  parameter  plane  for 
W  ^    0  and  it  can  be  readily  seen  that  for  any  p  and  z,    two 

values  of  co   can  be  obtained,  both  having  different  cost. 

n  i 

mi 

In  Figure  3.4a  and  3.4b,  ./ has  been  kept  constant 

pll 
at  1  but  for  the  cost  analysis  a  value  of  W  =  1  has  been 

used  in  3.4a  and  W  =  .5  in  Figure  3.4b.   A  comparison  of 

these  curves  shows  a  larger  cost  for  larger  W,  and  the  cost 

decreasing  with  an  increase  in  gain. 

On  Figures  3.4c  and  3.4d  the  gain  has  been  kept  constant 
at  10  and  the  weighting  factor  q, ,  varied.   These  figures 
show  a  decrease  in  cost  for  a  decrease  in  q,,,  and  a  slight- 
ly smaller  cost  for  larger  W.   The  value  of  p, ,  has  been 
kept  constant  for  these  and  the  following  cases. 

When  using  positive  feedback  any  value  of  damping  can 
be  used  and  the  results  are  shown  in  Figures  3.5  thru  3.7d. 

In  Figure  3.5,  K  has  been  kept  constant  at  1600  and  q,, 
varied  and  in  Figure  3.6,  q, ,  has  been  kept  constant  and 
the  gain  varied. 

The  loci  of  equal  cost  function  follows  different 
patterns  in  both  figures  but  in  general  an  increase  in  cost 
follows  a  decrease  in  gain. 
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Figure  3.4.   Constant  £  curves  for  different  values  of 
W,  negative  tachometer  feedback. 
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Figure  3.4a.   Constant  J  curves  for  W  =  .1  and/ 
negative  tachometer  feedback. 
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Figure  3.4b.   Constant  cost  curves  for  W  =  .5  and 
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=  1,  negative  tachometer  feedback. 
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Figure  3.4c.   Constant  J  curves  for  W  =  1.0  and  K  =  10 , 
negative  tachometer  feedback. 
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Figure  3.4d.   Constant  J  curves  for  W  = 
negative  tachometer  feedback. 
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Figure  3.5.   Constant  C  curves  for  W  =  0  and  positive 
feedback  for  constant  J  curves,  K  =  1600. 
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ELgure  3.6.   Constant    curves  for  W  =  0  and  positive 
tachometer  feedback  for  constant  J  curves , 
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A  comparison  between  Figure  3.3  and  Figure  3.5  shows 
that  for  negative  feedback  values  of  ?  >_  .707  are  restricted 
to  the  first  quadrant  while  for  positive  feedback  any  value 
of  C  is  permissible. 

Figures  3.7  show  the  parameter  plane  for  two  different 
values  of  W  and  for  different  c. 

A  comparison  between  negative  and  positive  feedback 
shows  same  results  as  for  W  =  0,  i.e.,  any  value  of  £  is 
permissible  in  the  first  quadrant  for  positive  feedback. 

Figure  3.7a  and  3.7b  compare  the  effect  on  cost  of 
different  values  of  W,  keeping  q, ,  constant  and  varying  the 
gain  which  results  in  larger  cost,  which  for  p  =  1.5  is 
0.75  for  W  =  1  and  1.25  for  W  =  2. 

Figures  3.7c  and  3 . 7d  compare  effect  on  cost  of  dif- 
ferent values  of  W,  keeping  the  gain  constant  at  10  and 
varying  q, , .   For  a  small  value  of  p  the  cost  is  smaller 
for  W  =  1  than  for  W  =  2  and  for  any  u)   there  is  a  minimum 

cost,  which  for  w  =  .7  is  about  0.19  for  W  =  1  and  0.3 

n 

for  W  =  2. 

Keeping  K   =    1.0  and  K  constant  at  10 ,  a  curve  of  cost 
against  frequency  has  been  drawn  and  the  results  shown  in 
Figure  3.8.   It  can  be  seen  that  the  cost  follows  the  shape 
of  a  parabola  increasing  very  fast  as  the  frequency 
approaches  2 . 

In  order  to  study  the  effect  of  the  weighting  factors 
on  the  steady  state  accuracy  it  is  convenient  to  refer  to 
the  equivalent  block  diagram  of  Chapter  I.   It  can  be  seen 
that 
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Figure  3.7.   Constant  J  curves  for  W  ^  0,  positive 
tachometer  feedback. 
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Figure  3.7b.   Constant  J  curves  for  W=2  and 
positive  tachometer  feedback. 
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Figure  3.7c.   Constant  J  curves  for  W  =  1  and  K  =  10 , 
positive  tachometer  feedback. 
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Figure  3.7d.   Constant  J  curves  for  V7=2  and  K=10, 
positive  tachometer  feedback. 
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Figure  3. 


J-oo   parameter  plane  for  £=1.0  and  K=10. 
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which  will  depend  only  on  q-Q  and  the  parameter  plane  is 
shown  in  Figure  3.9.  For  small  values  of  q, ,  the  steady 
state  error  is  also  very  small,  increasing  rapidly  as  q, , 

ft! 

increases  to  a  value  of  w =  2,  and  then  slowly  approach- 

pll 
ing  1.0  in  the  infinite. 

For  the  speed  of  response  study  it  is  convenient  to  use 

the  definition  of  settling  time,  i.e., 


Ceo 

n 


Several  cases  should  be  considered: 

1.  Negative  feedback  for  the  velocity.   Curves  of 
constant  settling  time  have  been  drawn  in  the  parameter 
plane  for  two  different  weighting  functions,  W=0  and  W=2, 
the  results  being  shown  on  Figure  3.9a.   It  can  be  seen  that 
the  settling  time  decreases  with  increasing  W. 

2.  Positive  feedback  for  the  velocity.   Constant 
settling  time  curves  for  the  same  parameters  as  in  the  pre- 
vious case  are  shown  on  Figure  3.9b.   This  curves  show  that 
the  settling  time  decreases  with  increasing  W  but  faster 
than  in  the  negative  feedback  case. 

3.  Negative  feedback  for  the  position.   The  results 
are  as  in  Case  1. 
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4.   Positive  feedback  for  the  position.   Using  Routh 
criteria  of  stability  it  can  be  seen  that  this  case  gives 
a  pole  in  the  right  hand  plane,  meaning  that  the  system  will 
be  unstable  and  the  regulator  will  not  regulate  at  all. 
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IV.   SENSITIVITY  IN  THE  OPTIMAL  REGULATOR 

A.   GENERAL 

An  optimal  design  guarantees  minimum  cost  for  the  regu- 
lator from  any  initial  conditions. 

If  any  parameter  of  the  regulator  deviates  from  the 
value  used  in  (or  determined  by)  the  optimal  design,  then 
the  cost  of  regulating  is  increased,  i.e.,  the  performance 
of  the  system  is  not  optimal. 

Sensitivity  is  a  word  used  to  describe  the  rate  at 
which  some  characteristics  of  the  system  deviates  from  a 
reference  value  as  a  function  of  a  parameter  change.   Thus 
various  types  of  sensitivity  could  be  defined: 

a.  Root  sensitivity 

b.  Bandwidth  sensitivity 

c.  Steady  state  accuracy  sensitivity 

d.  Settling  time  sensitivity 

e.  Rise  time  sensitivity 

f.  State  sensitivity 

g.  Cost  sensitivity 

State  sensitivity  is  a  measure  of  the  deviation  of  a 
dynamic  state  from  the  values  it  would  assume  if  the  system 
was  optimal. 

Cost  sensitivity  is  some  measure  of  the  deviation  of 
the  cost  from  the  optimal  cost. 

Ultimately  all  of  these  various  sensitivities  relate  to 
the  same  basic  characteristics  of  a  linear  regulator,  i.e., 
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they  indicate  changes  in  root  location  (possibly  excepting 
steady  state  accuracy  sensitivity) .   However  there  must  be 
some  basic  differences  in  these  various  sensitivities  in 
the  sense  that  some  are  vector  quantities  and  others  are 
scalars ,  i.e.,  root,  bandwidth,  settling  time  and  rise  time 
sensitivities  all  indicate  pretty  clearly  the  direction  in 
which  a  root  has  moved,  while  cost  sensitivity  only  indi- 
cates the  magnitude  of  the  root  motion. 

From  a  design  point  of  view  there  may  be  some  advan- 
tages to  the  cost  sensitivity,  i.e.,  one  can  usually  accept 
dominant  root  location  within  a  specified  s-plane  area, 
and  a  defined  area  on  the  parameter  plane  normally  maps 
into  a  dominant  area  on  the  s-plane.   Correlation  with 
other  performance  criteria  may  very  well  be  required. 

Cost  may  be  evaluated  at  any  point  on  the  parameter 
plane  and  thus  constant  cost  contours  can  be  obtained. 
Cost  sensitivity  in  a  macroscopic  sense  is  then  just  the 
difference  between  two  costs  divided  by  the  increment  in 
parameter  value  between  them. 

Cost  sensitivity  can  also  be  evaluated  at  a  point  and 
normally  the  point  of  greatest  interest  on  the  parameter 
plane  would  be  the  point  at  which  the  parameter  assume 
optimal  values.  Change  in  cost  from  this  optimal  value 
(for  a  small  change)  can  be  computed  by: 

T 

x  Aparameter  =  AJ 


d  (parameter) 


J4_   +    AJ   =   J4. 
opt  at   new  point 
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This  however  depends  on  initial  conditions  values, 
and  the  permissible  range  of  A  parameter  depends  on  the 
system  and  on  the  cost  function. 

B.   SENSITIVITY  OF  THE  COST  FUNCTION  AND  SENSITIVITY 
OF  THE  OPTIMAL  COST  FUNCTION 

In  the  research,  the  curves  of  constant  J  on  the  parame- 
ter plane  are  obtained  using  an  expression  for  J  which  is 
derived  in  terms  of  p,  K,  K, ,  K_  ,  where  p  and  K  are  plant 
parameters  and  K,  and  K_  are  values  for  the  state  feed- 
back loops.   In  order  to  use  the  expressions  the  system  is 
optimized  at  some  chosen  p  and  K,  and  values  of  K,  and  K~ 
are  computed  for  the  system  thus  optimized.   When  J  is  set 
to  a  non-optimal  value  K,  and  K_  remain  fixed  at  the  opti- 
mal values  and  p  and  K  are  computed.   The  system  is  not 
optimal  for  the  new  p  and  K. 

Sensitivity  of  the  optimal  system  could  be  defined  by 
taking  the  derivative  of  the  cost  function,  i.e., 


sJ     = 

9J 
o 

op 

3P 

P=Po' 

K=K 
o 

SJ      = 
oK 

J 
o 

9K 

P=Po' 

K=K 
o 

However  the  equation  for  J  optimal  can  be  written  in 
at  least  two  forms : 

A.  The  form  is  used  to  compute  J  curves,  which  con- 
tains the  feedback  gains  K,  and  K_  as  constants. 

B.  A  form  obtained  directly  from  the  R  matrix  such  that 
K.  and  K   do  not  appear  as  symbols,  the  cost  being 
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expressed  entirely  in  terms  of  p,   K,  q,, ,   ^22'  ^11" 
Both  forms  A  and  B  should  give  the  same  numerical 

answer  when  p  =  p     and  K  =  K  \_.      However  their  deriva- 
c        ^opt  opt 

tives  at  the  optimal  point  should  be  different,  because 
form  A  describes  a  system  that  is  not  optimal  when  p  and 
K  are  changed  from  their  optimal  values,  while  form  B 
presumably  expresses  the  condition  whereby  changes  in  p 
and  K  automatically  result  in  changes  in  K-.  and  K~  so 
that  the  system  remains  optimal  at  the  new  p,  K  values, 
but  of  course  with  different  value  of  J. 

Under  these  conditions  the  choice  of  a  definition  for 
sensitivity  becomes  a  matter  of  concern: 

Should  sensitivity  be  defined  on  the  basis  of  | J  | 
from  the  value  it  has  when  p  and  K  are  at  their  specified 
optimal  values?  or  should  be  defined  on  the  basis  of  the 


deviation  of   J]  at  point  p,  K,  from  J    J  at  point  p,K? 
By  this  last  statement  it  is  meant: 
If  K,  and  K~  are  evaluated  at  p ,  K,  then 

Jo  ■  f(Po'  V  Kl'  V 

At  some  new  set  of  plant  parameters  values  p  ,  K  , 

a    a 

Jl  =  f(Pa'  V  V  K2> 

which  corresponds  to  the  curves  drawn  on  the  parameter 

plane,  but  the  system  is  optimal  at  p  ,  K  .   If  the  system 

a    a 

were  optimal  at  p  ,  K  ,  K,  ,  K„  ,  would  have  to  be  deter- 

a    a    la    z  ex 

mined  and  the  cost  function  would  become 

Jla  =  f(Pa'  V  Kla'  K2a>   °Ptimal« 
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C.   SENSITIVITY  OF  COST  FUNCTION  TO  PLANT  PARAMETERS 
VARIATIONS 

If  K,  is  adjusted  for  the  optimal  value,  then 


1    V  p 


11 


11 


and 
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If  K2  is  also  adjusted  for  the  optimal  value  then 


^22     7         2K  Po    2K1 


Pll     2     Kc 


K 


and 


'11 


2    2K1 

2KT  +  - 

1     K 


(p  +  K2K)  +  K1K(2K2  + 


2K  p 
;_< 

K 


2K. 


-2K1K2 (p  +  K2K) 
2K, 


X2(0) 


2(p  +  K2K) 


—  x1(0)x2  (0) 


2K,      0    2KoP^    2Ki 

-r  +  2K2  +  -^  -  r2 


x2(0) 


2  (p  +  K  K) 
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This  is  the  cost  function  assuming  that  K,  and  K?  are 
adjusted  to  optimum  for  the  nominal  values  of  system 
parameters,  p   and  K  .   This  result  may  be  illustrated  more 
graphically  by  rearranging  as  follows : 


K 


K. 


Pii  =   2Ki   (  1  ~  -V-)  +  2KiKo  (rT-   P~  -  P) 


'11 


K 


12  VK   *o 
o 


2K. 
K 

2K. 


(p  +  K2K) 


x*(0) 


2(p  +  K2K) 


+  •—   x,  (0)  x  (0) 


2KX  (|  -  ^  )  + 


2  ^o     2  o 


K, 


4(0) 


2(p  +  K2K) 


The  sensitivity  becomes 


KP~  "  PK 


J  -  J 


2P_t  =  , 


'11 


Kl(l  -  — )  +  KlK2(- 

o o_ 

p  +  K2K 


K  K 

+  4  (P  +  K2K)  -  ^  (p   +  K2Ko) 


x^(0) 


+  2 


K     K 


x1(0)x2  (0) 


1  *K    K  ;    K. 

°_  +  .J. 

p  +  K0K      K 


p   +  K0K 
^o 2  o 

p  +  K2K 


-  1 


x2(0) 


(4.1) 


J  -  J 


2P_t  =  < 


'11 


ir  (Ko"K)  +  ~ir-  (kp0-pko' 

o  o 


p  +  K2K 


+  Ki<l-ir» 

o 


>   x*(0) 
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+    2K. 


1         J_ 
K    '      K 


x1(0)x2(0) 


+   < 


K     -  K 
Kl(-%~'     +    K2  (pQ    -    p)    +    K2(Ko-K) 


p  +  K,K 


K0(P+K2K) 


) 


x2(0) 


Note    these   become    zero  when   K -»•  K    ,    p  ->  p 

o'    *      ^o 


J-  J 


opt   _ 


'11 


k: 


\ 


(K    -K)     + 


K1K2 


K. 


(Kp   -pK    ) 


K     (p+K0K)   I  l    o       '  K     (p+K0K)  KK       v  *o  *o'     1 

\    °  2       J  \    °  2  °l  i 


xf  (0) 


2K, 

— -    (K    -K)     x,  (0)xo(0) 
KK  o  12 


K  K2\  K2 

K*r  +  sr  (VK)  +  k-  (p0-p» 

o  o  /  o 


>  2 


X2(0) 
(p+K2K) 


For    small    changes   where 


K   =   K      +    6K 
o 


K    -    K 


p   =   p      +6 
r        ^o  p 


P   =   P, 


6J 


'11 


k: 


K    +  (p    +K-K    ) 
,    o      ^o      2    o 


(1-6K) 


i    I    KiK: 


K. 


K         p    +K0K  K 

o    ^o      2    o  o 

2K. 


(6K)pQ   -    KQ(6p) 


x*(0) 


K 


-f-    (6K)x1(0)x2(0) 


A\\^J\ 


K. 


,?+    K" 


PQ+K2K 


6J 


'11 


-6K 
K2 


rp2Kn+K?K  K,p    +  K,K  " 

*o    1       1    o  l*o       1    2 


p    +K„K 
*o       2    o 


K 


-6p 


P    K, 
^o    1 


K    (p  +K.K  ) 
O  *o     2  o 


x*(0) 
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2K. 


K 


2^  (6K)x1(0)x2(0) 


+  <- 


K,+K0K 
1   2  o 


K. 


IT  (p  +K0K  ) 
o   o   2  o 


(6K)  - 


K  +(p  +K0K  ) 
o   ^o   2  o 


(6p) 


^x^(O) 


) 
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From  4.1  if  p  =  p   =30  and  K  deviates  from  the  optimal 
value  of  1600  a  curve  can  be  represented  in  the  parameter 
plane  and  is  shown  in  Figure  4.1.   Also  shown  is  the  curve 
for  K  =  K   =16  00  and  p  deviating  from  the  optimal  value. 
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Figure  4.1.   Sensitivity  of  cost  function  to  plant 
parameter  variation. 
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V.   CONCLUSIONS 

RESULTS 

An  optimal  regulator  can  always  be  obtained  using  the 
parameter  plane  method  for  any  given  plant.   Both  negative 
and  positive  feedback  can  be  used  to  achieve  the  desired 
results  but  only  negative  position  feedback  should  be  used 
to  obtain  a  stable  system.   Positive  position  feedback 
gives  an  unstable  system  with  no  regulation  at  all. 

For  a  given  plant  an  optimal  cost  function  can  be 
obtained  and  the  values  of  the  feedback  path  gain  calcu- 
lated using  the  curves  of  Chapter  II. 

When  a  given  frequency  and  damping  is  desired,  the  plant 
parameters  needed  to  achieve  the  results  can  be  obtained 
for  different  weighting  functions  with  the  use  of  figures 
of  Chapter  III,  or  for  a  fixed  plant  the  performance  and 
cost  be  obtained  by  the  use  of  the  same  figures. 

For  plant  parameters  variations  the  sensitivity  of  the 
cost  can  be  obtained  using  the  figure  in  Chapter  IV. 
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APPENDIX  A 


GENERAL  EXPRESSION  FOR  THE  R  MATRIX 


From  the  reduced  Ricatti  equation: 


ATR   +  R  A  -  R  BP~1BTR   +  Q  =  0 
o    o     o       o 


(A.l) 


where 


A  = 


0    1 
0   -p 


AT  = 


0 

0 

B  = 

ro 

1 

-p_ 

i 

_K_ 

B1  =  [0   K] 


R   = 
o 


rll   r12 


r12   r22 


Substituting  into  A.l 


rll   r12 


r     r 
12    22 


+ 


rll   r12 


r     r 
12    22 


0    1 
0   -p 


rll   r12 


y  r 

12    22 


rll   r12 


r12   r22 


*11 

0     q 


0 
22 


=  0 


0   K 


rll  pr22   r12  pr22 


+ 


0      rn-pr12 
0      r12-Pr22 


11 


22 


=    0 


2  2 

K   r12  K   r12r22 

2  2 

K    r12  K   r22 


„2    2 
-K   r12    +   qn 


11   ^12 


12    22 


=      0 


rn-Prn"K    rioroo      =       ° 


(A. 2) 
(A. 3) 
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rirPr12"K    r12r22  =    ° 


2(r12-pr22)-K2r22+q22 


From  A. 2 


11 


12 


K' 


r    =  + 
12 


Lll 


K 


(A. 4) 
(A. 5) 


Substituting  in  A. 5 

2  v/^IT 


.2  2 


K 


'  2Pr22  "  K  r22  +  q22  =  ° 


Since  Q  must  be  positive  definite  q,  ,  must  be  positive, 
but  both  signs  will  be  used  with  the  radical. 


K2r22  +  2pr22  -  q 


22 


2  v/qll 

±  — - — —  =  0 
K 


-2p  ±  /4p2  +  4K2(q22  ± 


2  /q 


11. 


K 


22 


2K< 


_    \/4p2  +  4K2(q22  ±  -~^) 


K' 


2K' 


As  r~~   must  be  positive  only  the  positive  sign  outside 
the  radical  can  be  used,  and  the  negative  sign  inside  the 
radical  only  if 

2        2/qTl 
4K  (q22  "  "V^  ^° 


i.e.  for 


22 


2   q 


11 


K 


Then,  both  signs  will  be  carried  with  the  indicated  restric- 
tion implied. 
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From  A. 3  and  A. 4 


p  yq. 


11 


11 


K 


/qnV    /a 


p  +K  q22  ±  2K/q^ 


.  +  ^11 


K 


pz+Kzq22  ±  2K/q^ 


Thus  the  general  expression  for  the  R  matrix  is: 


R   = 
o 


/q 


11 


K 


yp2+K2q22  ±  2K/qxl 


+  ^iT 


K 


K 


^  + 


2 

E_  + 

4     2 
K     K 


q22  +  2/^Tl 


K" 
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APPENDIX  B 
GENERAL  COST  FUNCTION  FOR  A  SECOND  ORDER  SYSTEM 

The  following  derivation  was  originally  worked  by  Dr. 
Sidney  R.  Parker  and  has  been  included  because  its  extensive 
use  in  this  thesis  and  not  being  published  in  any  paper. 

It  has  been  shown  that  for  the  general  second  order 
regulator 


J  =  /   (xTQx  +  UTpU)  dt 


where 


If 


Then 


Q  = 


«11 

0     q 


0 
22 


/   P  =  P-i  -i  an<3  U  = 


K1K2 


x. 


T       T       T 
X  Qx  +  U  pU  =  x  Mx 


(B.l) 


— ■ 

—  — 

T       T 
x  Qx  +  U  pU  = 

-  — 

x2 

*11 

0 

( 

q; 

) 

>2_ 

xl 
_X2_ 

+ 

xx   x^ 

Kl 
K2_ 

Kx   K^ 

xi 

_X2_ 

?11 

Kl     K1K 
*1K2    K2 

1         ^ 



= 

x1   x^ 

qll    0 
_0     q^ 

+ 

2 

b 

> 

Xl 
l_X2_ 

= 

*1   x2_ 

Pi] 

kik: 

2 

LI 

I 

q2: 

>11 

K1K2 

2 

2pll 

xi 

X2 
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Then  from  B.l 


-   mll  =  qll  +  Klpll 


m12  =  m21  =  P11K1K2 


m22  =  q22  +  K2pn 


Then: 


T 
X  MX 


-h 


mll   ml2 
m12   m22 


x. 


X, 


■  mllxl  +  2m12x1x2  +  m22x22 


If: 


-Xit 

x,  =  a,  e   x   +  a~  e 


-X2t 


then 


-x.t  -x2t 

x2  =  -X^e     -  X2a2e 


and 


m,  ,  x,  =  m 


11"1    "11   1 


-  7    -2X  t        -(X  +X  )t 
afe     +  2ana„e 


12 


+  a^e 


-2X  f 


and 


then 


/   m,  ,  x,  dt  =  m,  , 
o 


-2  2-i 

a      2aiao    a2 

2X^+  X-iT^+  2X^ 


(B.2) 


m22x2  =  m22 


-   2  "2Ait  -(X  +X  )t   2  2  -2X2tn 

X  a  e      +  2X.Xa.a-e         +X  a  e 


00  p 

/      m0_x0dt   =   m 


22    2 


22 


rXlal         2AlX2ala2         X20t21 


2X 


x1+x2 


2X 


2  J 


(B.3) 


m12XlX2  =  "2m12 


then 


r  -at 

X..  a,  e 


2  "2X2t  -(X^X^t 

+  X_a2e     +  a,a2(X.+X2)e 


/   m12x1x2dt  =  -2m 
o 


"Xlal  X2a2_ 

+  a,  a~  + 


2X 


12    2X 


(B.4) 
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And 


J  =  B.2  +  B.3  +  B.4 


=  m 


11 


a  2 
1 
L2A1 


2ala2    a 


x1+x2 


2\ 


-  2m 


12 


rXlal    W|W    X2a2 


2X 


x1+x2 


2X, 


+  m 


22 


rXlal    2A1A2a1a2 


X2X2-. 


2X. 


x1+x2 


2A 


2  J 


(B.5) 


To  find  A.,  and  X»  let: 


*> 


s  (s+a) 


K. 


K. 


x. 


R 

o 


s  +as+K]_G 


K  s 


x. 


R     s2  +  (a+K  G)s  +  K;,G 


a)  =  /kTg 

n       1 
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2£w      =    a   +    K~G 
n  2 


C    = 


a  +   K2G 


2    /KjG 


Then 


Let 


2  2 

s    x,    +    2c;co    sx,    +    oo    x,    =   GR 
1  n      1  n    1 


Xl         Xl       '       X2         Xl 


.*.    x~    =    -2£co    x.    -    (i)    x.    +    GR 
2  n    2  n    1 


x. 


x. 


-co  -2Coj 

n  n 


r~  ~\ 

xl 

+ 

0 

_X2_ 

G 

R 


when   R  =    0 


x 


sI-A 


-1 


x(0) 


sI-A 


SI-A 


-1 


oo  s  +  2c~;oo 

n  n 


-1 


2  2 

s    +  2tco      s+co 
n  n 


s+2£oj        1 
n 


-co  s 

n 


x. 


2  2 

s    +  2cco   s+co 
n        n 


s+2£oo 


n 


-co 


n 


x1(0) 
x2(0) 


x.    = 


(s+2Ccon)x1(0)+x2  (0) 

s    +2Cw   s+co 
n        n 


(s+X1+A2)x1  (0)+x2 (0) 
(s+X1)  (s->X2) 


X2    = 


•oo^x,  (0)    +    sx0  (0) 
n    1 z 

2~Z  2 

s    +  2tco    s-*co 
n        n 
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1    s+X,    s+X. 


where 


1      n    n  " 


X~    =    £0)      -   CO     </ 

2    ^  n    n  V 


c2-i 


a 


(s+2cu  s)xn  (0)  +  x0 (0) 
n    1        2 


s+ 


s=-X. 


(-X.+2C0)  )xi  (0)+x,(0) 

x2-x1 


X2X1(0)  +  X2(0) 

i  "     x2-x1 


(B.6) 


Similarly : 


a2  = 


X1x1(0)  +  x2(0) 

=Tx7^) 


(B.7) 


Note  that : 


(a1  +  a2)  =  x1(0) 


From  B . 5 : 


2  -, 


'11 


A 


Ta  n       a  a      a  ' 
+  2  :  .    + 


2X 


x1+x2 


2X 


"  K1K2 


2         2- 
a  +2a. a2+a 


+  B 


2  2-i 

a..     2a-a_     a_ 

+  — ,    ,  + 


L2A1X    Xi1+  21 


X 


-1 
2  J 


(B.8) 


where 


2    qll 


a  =  k:  +  - 
i   p 


li 


q22 


B  =  K~  +  - 

2    p 


11 
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Substituting   B.6    and   B.7    into   B.8    and   rearranging 

2  -v 


'11 


r~X2 
A2 


(x2-xx) 


2A1       T-^T2 


2X1X2    +    Xl 


2X 


+ 


B 


(Xn-Xn) 


r     2  2-i 

X2  2X1X2 


2    "1'      L~"l 


2X,1         X.Vx""1 


1         2 


2X 


-1 
2   J 


"    K1K2 


\    x*(0) 


A 


1<VV 


2     -     ?     4-        1 

i —      *  +  ^ — 

x1  x2 


+ 


B 


<V*1> 


X 


^i1 


2(X1+X2)         Xx 


(X-^x"1)       X"^ 


x1(0)x2(0) 


+ 


(X^) 


2A 


2  +      ! 


(A1+A2)         2A2 


B 


(Xj-Xj) 


L2A    1 


a-^a;1 


+ 


2X 


-1 
2    -M 


x2(0)      (B.9) 


Substituting 


A.    =    £>      +   03    ./C    -1      =   a  +  b 

1  n  n  V/ 


X0    =    £to      +o)    v  /C    -1      =    a    -   b 
2  n  nv 


X,X_    =    a   -b 


into    B.9. 


'11 


A 


4b' 


(a-b)' 
2 (a+b) 


2~] 


2  (a   -b    )_         (a+b) 


2a 


2 (a-b) 


J 


4b 

"K1K2 

(a-b)2  (a+b)         2  (a2-b2)      |    (a+b)2 (a-b) 


2a 


x2(0) 
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+ 


4b' 

A 

4b: 

B 


a-b  __    a+b 


a+b 


a-b 


x1(0)x2(0) 


2  +    1 


4b' 


2 (a+b)   2a    2 (a-b) 


a+b    2  (a2-b2)    a-b"] 
2        2a        2  J 


x2(0) 


(B.10) 


Adding  and  rearranging 

f    5a2-b2 


'11 


A 


u 


a(a2-b2) J 


|   +    B(a2-b2)    .     ■ 


4a 


12 


»  x2(0) 


+ 


x]L  (0)x2  (0) 


2       2 
I4a(a   -k>    ) 


B 
4a 


x2(0) 


(B.ll) 


Substituting 

a   =    Coj 


n 


b  -  «n./r 


into    B.ll 


'11 


2  2  1X1(0) 

A(1+4?     )     +    B%    -    4C%    KXK2       -jgj. 


n 


But 


+    -A.  X;L(0)x2(0) 

CO 

n 


[; 


■7    +  B 

n 


x2(0) 

4Tw 
n 


A   =    K7    +    - 
1         P 


11 


11 


B   =    K2    +    511 
2         Pn 


OJ       =    K,  K 
n  1 


66 


Then  '., 


2Cw      =   p+K„K 
n        ^2 


'11 


Mll 
2  2 

q        ,  (K,+    p,,)  (p+K9K)  |    -       q 

K7    +    -ii      +    ± i±- = +K.K    IC+    -^ 

Pn    |  KXK  1     \    2       p 


'11 


111 


-  2K1K2(p+K2K) 


X^(0) 
2(p+K2K) 


2   qll 
1   Pn 
+  -K-K—   x1(0)x2(0) 


2.  qll 


k;+  - 
i    p 


11 


+  KI+ 


.q22 


2  P 


11 


*2(0> 

2(p+K2K) 


(B.12) 
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